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DETAILED ACTION 

1 . Claims 1-9, 21-40are pending in this application and have been examined in 
response to application amendment filed on 02/01/2008. 

2. Claims 36-40 are new. 

Claim Rejections - 35 USC §112 

3. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

4. Claims 36 and 37 recites the limitation "the computer program". It is not clear if 
the computer program is "the source computer program" as recited in claims 1 and 21 . 

5. Claim 38 recites the limitation "the application". It is not clear if "the application" 
is the equivalent of "the computer program" or the "API". 

6. Claim 39 recites the limitation "the user interface platform". There is insufficient 
antecedent basis for this limitation in the claim. 

7. Claim 40 recites the limitation "the application frame". There is insufficient 
antecedent basis for this limitation in the claim. 
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Claim Rejections - 35 USC § 102 

8. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

9. Claims 1-9, 21-38 and 40 are rejected under 35 U.S.C. 102(b) as being 
unpatentable by De Armas et al. (De Armas, US 5,864,819). 

1 0. As to INDEPENDENT claim 1 , De Armas discloses a method of generating 
identifier data for persistently identifying a user interface element of interest in a 
graphical user interface of a source computer program, the method comprising: 

receiving data indicative of the user interface element of interest from a first 
software component (col .2, lines 59-65; a window object of interest is sent to a first 
software component navigator application); and 

in response to receiving the data indicative of the user interface element of 
interest, generating an element path identifier of the user interface element of interest 
for persistently and uniquely identifying (col. 3, lines 16-19; col. 6, lines 15-20; attributes 
such as the parent/child/sibling relationships of each of the interface elements allows for 
the interface elements to be uniquely and persistently identified across different 
application states) the user interface element of interest and returning at least the 
unique element path identifier to the first software component (col. 9, lines 27-31 , 39-43; 
the element of interest is found via the element of interest's attributes, once the element 
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of interest is found, a window handler that corresponds to the element of interest is 
returned to the navigator application); 

wherein persistently and uniquely identifying the user element of interest 
comprises persistently and uniquely identifying the user interface element of interest 
across reboots of the computer running the source computer program ( col.7, lines 9-12; 
element attributes are saved in a context data file to allow future retrievals^ 

11. As to claim 2, De Armas discloses wherein generating the element path identifier 
is implemented by a second software component communicative with the source 
computer program (col. 5, lines 30-34; a software analysis tool is used to form a 
hierarchical tree of the source computer program). 

12. As to claim 3, De Armas discloses wherein generating an element path identifier 
comprises: 

using a hierarchical tree structure representation of the graphical user interface 
to locate a leaf node related to the user interface element of interest (col. 5, lines 1-2; a 
hierarchical representation of elements in an application is presented); 

storing exposed identifier information of the user interface element of interest in 
an element path identifier data structure (col.3, lines 22-29; various attributes relating to 
the user interface elements are stored); and 

proceeding up the hierarchy of the tree structure representation to store the exposed 
identifier information of selected parent nodes of the user interface element of interest in 



Application/Control Number: 10/692,923 Page 5 

Art Unit: 2100 

the element path identifier data structure (col.5, lines 60-64; parent/child relationship 
between window objects are preserved). 

1 3. As to claim 4, De Armas discloses converting the element path identifier to a 
string type data structure (col. 3, lines 22-27). 

14. As to claim 5, De Armas discloses receiving data indicative of a designated 
element path root node of the tree structure representation, wherein the step of 
proceeding up the hierarchy of the tree structure representation to store the exposed 
identifier information of selected parent nodes is continued only until the element path 
root node is reached (col.5, lines 2-6; a complete analysis of the source computer 
program is performed to indicate parent/child relations and various other attributes 
associated with interface elements of the source program). 

15. As to claim 6, De Armas discloses wherein the exposed identifier information is a 
local alpha numeric identifier not guaranteed to be unique, a class name, a module 
name associated with an application program or a sibling order (col. 7, lines 42-43; 
objects at their respective local level can share a common set of attributes). 

16. As to claim 7, De Armas discloses determining that at least one of the selected 
parent nodes is a root node of a strongly named branch portion of the tree structure 
representation, wherein the strongly named branch portion has at least one user 
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interface element within a scope inside of which the at least one user interface element 
is guaranteed to be uniquely identifiable by a named branch element identifier (col. 5, 
lines 44-46, 52-55; a sub-context tree is created for each application state, since the 
parent/child relations are preserved in each of the sub-context tree representing each of 
the application states, there must be at least one unique child element from each sub- 
context tree because each application state is unique from each other) and 

storing in the element path identifier data structure, the named branch element 
identifier for the at least one user interface element within the scope of the named 
branch portion (fig.5A). 

17. As to claim 8, De Armas discloses storing in the element path identifier a strong 
name associated with the strongly named branch along with the named branch element 
identifier (col. 5, line 45; a child of a strongly named branch parent encompasses a 
strong name since information from the parent is contained in the child). 

18. As to claim 9, De Armas discloses wherein the named branch element identifier 
stored in the element path identifier data structure is for the user interface element of 
interest and no identifying information related to the parent elements within the scope 
are stored in the element path identifier data structure (col. 7, lines 42-43; objects at their 
respective local level can share a common set of attributes). 
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1 9. As to INDEPENDENT claim 21 , De Armas discloses at least one computer- 
readable medium having stored thereon computer-executable instructions related to a 
function responsive to a function call from a first software component, the function 
comprising: 

an input parameter representing a user interface element of interest in a graphical 
user interface of a source computer program (col. 2, lines 59-65; a window object of 
interest is sent to a first software component navigator application); 

an output parameter representing an element path identifier for persistent unique 
identification of the user interface element of interest; wherein the element path 
identifier comprises a hierarchical path of the inheritance from the user interface 
element of interest to a parent root element_(col.5, line 45; col. 6, lines 15-20; attributes 
such as the parent/child/sibling relationships of each of the interface elements allows for 
the interface elements to be uniquely and persistently identified); and 
executable software for receiving the input parameter representing an user interface 
element of interest and in response, generating the output parameter representing an 
element path identifier of the user interface element of interest (col. 9, lines 27-31 , 39- 
43; the element of interest is found via the element of interest's attributes, once the 
element of interest is found, a window handler that corresponds to the element of 
interest is returned to the navigator application) such that the output parameter 
represents an identifier capable of persistently identifying the user interface element of 
interest across different builds of the computer program ( col.3. lines 16-19; col. 6, lines 
15-20; attributes such as the parent/child/sibling relationships of each of the interface 
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elements allows for the interface elements to be uniquely and persistently identified 
across different program states or builds) 

20. As to claim 22, De Armas discloses wherein the element path identifier is a string 
type data structure (col. 3, lines 22-27). 

21 . As to claim 23, De Armas discloses wherein the element path identifier 
comprises exposed identifier information of component elements of an element path 
related to the element of interest (col. 5, lines 18-21 ; "window objects"). 

22. As to claim 24, De Armas discloses wherein the element path identifier 
comprises class names of component elements of an element path of the element of 
interest (col .3, lines 22-25; "class name"). 

23. As to claim 25, De Armas discloses wherein the element path identifier 
comprises a module name of an application program related to component elements of 
an element path of the element of interest (col. 5, lines 10-15; "top-level window object"). 

24. As to claim 26, De Armas discloses wherein the element path identifier 
comprises sibling order data (col. 6, lines 17-20; "siblings"). 



25. 



As to claim 27, see rationale addressed in the rejection of claim 7 above. 
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26. As to INDEPENDENT claim 28, see rationale addressed in the rejection of claim 
21 above. 

27. As to claim 29, see rationale addressed in the rejection of claim 22 above. 

28. As to claim 30, see rationale addressed in the rejection of claim 23 above. 

29. As to claim 31 , see rationale addressed in the rejection of claim 24 above. 

30. As to claim 32, see rationale addressed in the rejection of claim 25 above. 

31 . As to claim 33, see rationale addressed in the rejection of claim 26 above. 

32. As to claim 34, see rationale addressed in the rejection of claim 7 above. 

33. As to INDEPENDENT claim 35, see rationale addressed in the rejection of claim 
21 above. 

34. As to claim 36, De Armas discloses persistently uniquely identifying the user 
interface element of interest across different builds of the computer program (col .3, lines 
16-19; col. 6, lines 15-20; attributes such as the parent/child/sibling relationships of each 
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of the interface elements allows for the interface elements to be uniquely and 
persistently identified across different application states). 

35. As to claim 37, see rationale addressed in the rejection of claim 36 above. 

36. As to claim 38, De Armas discloses the element path identifier identifies the 
application in which the user interface element resides (col. 3, lines 15-20; "target 
application"). 

37. As to claim 40, De Armas discloses the element path identifier identifies the 
application frame in which the user interface element resides (fig.1 B; parent window 
frame "26" and child window frame "28"). 

Claim Rejections - 35 USC § 103 

38. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

39. Claim 39 is rejected under 35 U.S.C. 103(a) as being unpatentable over De 
Armas and Mir Farooq ali et al. ("Mir", Building multi-platform user interfaces with UIML) 
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40. As to claim 39, De Armas discloses the element path identifier identifies a 
plurality of element attributes (col. 3, lines 22-23). De Armas does not disclose an 
identifier that identifies the user interface platform used to create the user interface 
element. 

In the same field of endeavor, Mir discloses an identifier that identifies the user interface 
platform used to create the user interface element (sect 4.1 , last par.). 

It would have been obvious to one of ordinary skill in the art, having the teaching of De 
Armas and Mir before him at the time the invention was made, to modify the combined 
attributes usable to strongly define user interface elements taught by De Armas to 
include a user interface platform identifier taught by Mir with the motivation being to 
allow a unified user interface element identifier description across different platforms. 

Response to Arguments 

41 . Applicant's arguments filed 02/01/2008 have been fully considered but they are 
not persuasive. 

Applicant argues that De Armas does not disclose persistently uniquely identifying the 
user interface of interest across reboot of the source program because De Armas uses 
relies on window handles as "an essential piece of information" necessary for unique 
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identification of a window object, wherein upon a reboot, the window handles are 
destroyed. 

In response to applicant's argument, De Armas discloses persistently uniquely 
identifying the user interface of interest (col.3, lines 16-19; col. 6, lines 15-20; attributes 
such as the parent/child/sibling relationships of each of the interface elements allows for 
the interface elements to be uniquely and persistently identified across different 
application states) across reboot of the source program (col. 7, lines 9-12; element 
attributes are saved in a context data file to allow future retrievals). Window handles 
are used to map or match user interface elements with identifier information pre-stored 
on the context data file (col.7, lines 9-12; col.9, lines 26-42). 

Conclusion 

42. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See M PEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HAOSHIAN SHIH whose telephone number is (571)270- 
1257. The examiner can normally be reached on m-f 0730-1700. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Dennis Chow can be reached on (571) 272-7767. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

HSS 

/DENNIS-DOON CHOW/ 

Supervisory Patent Examiner, Art Unit 2173 



